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00:00:00 1 ADVERSE EXAMINATION 

08:51:41 2 BY MR. LOVE (CONT'D): 

08:51:41 3 Q. Good morning. Dr. Verhalen. 

08:51:43 4 A. Good morning. 

08:51:43 5 Q. How are you today? 

08:51:44 6 A. Fine. Thank you. 

08:51:45 7 Q. You understand that you are still under oath 

08:51:48 8 just as yesterday and this is a continuation of your 

08:51:51 9 deposition as an expert witness in this case? 

08:51:53 10 A. Yes, I do. 

08:51:54 11 Q. Dr. Verhalen, do you agree that smoking is a 

08:51:58 12 substantial factor in the development of lung cancer 

08:52:02 13 in some people? 

08:52:04 14 A. It may be, yes. 

08:52:08 15 Q. And perhaps to be efficient about this, when you 

08:52:14 16 add the words "may be" to my statement, is this the 

08:52:21 17 same discussion we had yesterday about causation? 

08:52:24 18 A. Yes, it is. 

08:52:24 19 Q. So when I use the words "cause or substantial 

08:52:28 20 factor of a development in the disease," it's your 

08:52:31 21 opinion that the most anyone can say about that is 

08:52:34 22 that smoking may be a substantial factor in the 

08:52:39 23 development of a particular disease? 

08:52:40 24 A. That's correct, on the basis of information 

08:52:43 25 currently available so far as I know. 
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08:52:47 1 Q. And it's also your opinion that, for example, 

08:52:52 2 smoking may not be a substantial factor in the 

08:52:55 3 development of lung cancer in people? 
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A. That is conceivable, that's correct. 

Q. Is it conceivable that smoking is not a 
substantial factor in the development of lung cancer 
in anyone? 

A. That's conceivable although perhaps not so 
likely. 

Q. Is it your opinion that one cannot measure the 
percent of any people with the disease for whom 
smoking was a substantial factor in the development 
of that disease? 

A. Yes, I would agree that you cannot measure it. 
You may make some estimates, but there is an 
unsatisfactory known error around those estimates. 

Q. And if you made such an estimate could you use 
that to estimate health care costs involved in 
treating that disease? 

A. I think if you were trying to get at health care 
costs, in a very general sense you may be able to 
make some estimates, but the degree of precision to 
which you could make those is an open question in my 
mind, and the number of potential confounding factors 
makes it, for all practical purposes, useless if 
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you're going to zero in on a real hard number. 

Q. For the purpose of estimating to a reasonable 
degree of certainty what the smoking attributable 
health care costs are for any population is it your 
opinion that the data that's currently available is 
simply insufficient to do that? 

MR. BORMAN: Object to the form. Go 


ahead. 


THE WITNESS: In my estimation I 
think it's probably inadequate. 

BY MR. LOVE: 

Q. Probably or you believe it is inadequate? 

A. I believe it is inadequate. 

Q. And I take it you would not accept anyone's 
estimate of that amount then? 

A. I would not accept anyone's estimate; is that 
your question? 

Q. Right. 

A. That's correct, not as a definitive estimate. 
It's just an estimate. 

Q. But you wouldn't even accept it as being an 
estimate that could be made within a reasonable 
degree of certainty, correct? 

A. Not with a reasonable degree of certainty, 
that's correct. 
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Q. And in your opinion it's not the kind of 
estimate that you believe should be used as a basis 
for making a damages' calculations in any kind of 
litigation? 

A. Absolutely not. 

Q. When you say "absolutely not," you're agreeing 
with my statement? 

A. That's correct. 

Q. Yesterday we discussed the NEISS System that you 
conceived and helped develop, correct? 
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A. Yes. 

Q. Did the Consumer Product Safety Commission ever 
use the NEISS data in any way other than identifying 
products for further investigation of individual 
incidents? 

A. Yes, they did. 

Q. What are the ways they used the NEISS data? 

A. They used it to set priorities for budget 
purposes so they would have an idea of what products 
they could most effectively address their attention 
to in any given year. 

Q. By address their attention to, do you mean in 
some way other than investigating individual 
incidents involving a product? 

A. Yes, indeed. It may be just in terms of setting 
STIREWALT & ASSOCIATES 

P.0. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

221 

up a project to take a closer look at a product which 
would include investigations among other things. 

Q. So they would use the NEISS data to prioritize 
projects in their budget; is that correct? 

A. Yes. Not exclusively, but certainly to help 
them to decide which products seem to be frequently 
enough involved in product related injuries treated 
in hospital emergency rooms that it would warrant 
their attention. 

Q. Are there any other ways in which the CPSC used 
NEISS data? 

A. Occasionally the data would be analyzed to 
determine the relative distribution of products or 
product related injuries. 

Again, to help decide whether or not a product 
was worthy of the Commission's attention. 

Q. What type of statistical analysis was performed 
on the NEISS data if any? 

A. Usually nothing more than what I would call 
tuberculosis accounting; that is counting up the 
number of cases estimated to be associated with any 
particular product and deciding which ones seem to be 
associated with sufficiently more products, then the 
Commission would want to take its limited resources 
and take a closer look. 
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Q. Which ones would be associated with sufficiently 
more injuries? 

A. Yes, product related injuries. 

Q. So really a simple count is the way it would be 
analyzed? 

A. That's correct. 

Q. While you were with the CPSC did it ever 
estimate the cost of injuries including the health 
care costs of treating those injuries? 

A. I don't recall them making a discreet analysis 
of health care costs. There was an attempt by 
another director to get at the total cost of 
injuries, but those are by economists and they were 
usually data from other sources. 

Q. So another directorate within the CPSC was 
trying to determine total costs involved with other 
injuries? 
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A. That's correct. 

Q. In doing that did the CPSC estimate any costs 
that would be avoided if the injury, in fact, killed 
someone? 

A. Not that I recall. They may have, but again, 
that would have been made by a different director. 

Q. In your opinion is that something that the CPSC 
should have considered in measuring the total cost of 
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the product injuries? 

A. No. 

Q. Is the estimate of how many dollars would be 
saved by preventing a death something they should 
consider? 

A. No. 

Q. Is the estimate of how many dollars might not be 
spent on health care considered; for instance, if a 
product killed a person so that they didn't live 
longer and get some other disease or condition that 
required health care in the future because that 
person had no future? 

A. No, I don't think so. 

Q. You don't think that would be appropriate? 

A. I don't think that they did it, and I don't 
think that it would be appropriate. 

Q. Do other federal agencies use the NEISS data in 
any way? 

A. Several other federal agencies use NEISS data. 

Q. How do they use it? 

A. I don't know how they use it. They just 
contract with us to get it because we have a 
system — not we because I'm not there anymore, but 
the Consumer Product Safety Commission has a system 
which is unique and gathers data much more cheaply 
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than it would gather elsewhere. 

Q. Are you aware of any other federal agency that 
performed any type of statistical analysis on NEISS 
data? 

A. I suspect other agencies perform statistical 
analysis on NEISS data, but I don't know what that 
analysis would be or what they've done with it other 
than the Centers for Disease Control which didn't 
have a regulatory authority, but collected data on 
gunshot wounds through the NEISS so that they could 
analyze it and produce articles on gunshot injuries, 
but I was neither involved in that nor responsible 
for doing any of the work to help produce the 
articles. 

Q. Other than the gunshot situation, I take it 
you're not aware of any other situations in which 
federal agencies — specific situations in which 
federal agencies performed a statistical analysis on 
NEISS data, are you? 

A. I'm not personally aware of any. 

Q. Did you read any of the articles on the gunshot 
analysis? 

A. I may or may not have seen any. They've 
produced several. 
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Q. Do you have any memory today of what those 
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articles conclude? 

A. No. 

Q. Or what analysis they performed? 

A. I don't think — I don't think they had 
conclusions. I think they were descriptive analyses 
of the distribution of gunshot wounds, but I can't be 
certain. I don't recall. 

Q. Distribution by what? 

A. By state, by race, by whatever factors they were 
interested in. 

Q. Now, yesterday I believe you told me that prior 
to your work on these three tobacco cases you've 
never made any use or worked with NMES; is that 
correct? 

A. That's correct. 

Q. Prior to your work on these three tobacco cases 
have you made any use of NHANES data? 

A. No, I haven't. 

Q. What about BRFSS data? 

A. No, I haven't. 

Q. Do you have any opinions regarding the validity 
of the NHANES data that Drs. Zeger, Wyant and Miller 
used in their work that's reflected in their expert 
report? 

A. No, I don't. 
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Q. Do you have any expert opinion with respect to 
the validity of the BRFSS data in Minnesota as used 
by Drs. Zeger, Wyant and Miller in their work? 

A. As to whether or not it is validly used by the 
State of Minnesota? 

Q. Whether or not the data is valid. 

A. May I ask what you mean by valid? 

Q. Whether that data was collected in a proper way 
and fairly reflects the situation in Minnesota on the 
issues it addressed. 

A. I don't have information on the number of 
individuals within Minnesota who responded to the 
questionnaires year by year, but I do know that the 
BRFSS has an average of only about a thousand or 
eleven or twelve hundred cases per year for each 
state who participates as an average, and that being 
the case, there would be a statistical error 
associated with any estimates made from those that 
would be proportionate to whatever size sample they 
have. 

The BRFSS did not necessarily produce a high 
level of confident data — or of data on which you 
could have great confidence for all states. 

Q. Do you have any specific information about the 
BRFSS that was conducted in Minnesota as to whether 
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it was more comprehensive or involved more 
respondents than the national average? 

A. No, I don't. 
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Q. And it's true, isn't it, that with any survey 
data that there is a certain error level associated 
with that data? 

A. That's correct. 

Q. Yesterday we briefly mentioned a document that 
you authored called The Guidelines for Documentation 
of Epidemiological Studies. Do you recall that? 

A. Yes. 

Q. I've got a copy of your article here. 

MR. LOVE: Let's mark it. 

(Plaintiffs' Deposition Exhibit 3307 - article - 
marked for identification.) 

BY MR. LOVE: 

Q. Dr. Verhalen, I'll show you an article we have 
marked as Exhibit 3307, an article from the American 
Journal of Epidemiology. 

It's got the contents from that particular 
journal issue, and then it's followed by the article 
entitled Guidelines for Documentation of 
Epidemiologic Studies, and I ask if that's the 
article that you authored. 

A. Yes, I was a co-author in that. 
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Q. Are the other co-authors listed in the footnote 
of the first page of the article? 

A. They are. 

Q. Were these guidelines designed to apply to 

surveys such as NMES? 

A. They would not have been directly applied for 
that, however, I think the consensus of the group 
would have been that they probably should have been 
applied. 

Q. I note that on page 612 of the article - 
numbered at the top left 612 - there is a section 
with Roman numeral IV called Data Collection 
Procedures. 

Would that be a portion of the guidelines that 
would apply to a study such as NMES? 

A. Yes. 

Q. Did NMES to the 1987 study fail to follow these 
guidelines in any way? 

A. I really didn't look at it from that 
perspective. I don't know. 

Q. Is that something that you can address today 
during your deposition or do you need a significant 
amount of time to review NMES to answer that 
question? 

A. I would prefer to review NMES again and review 
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the guidelines again. 

Q. Is there anything you can tell me at all today 
about the extent to which NMES did or did not follow 
these guidelines? 

A. Among the documents which I saw on NMES, I did 
not find sufficient documentation in all aspects that 
would give me great confidence in it. 

But since NMES was not being used for regulatory 
purposes, I would not have had that in mind when I 
was looking at it. 
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Q. Do you believe you have seen all the 
documentation that's associated with NMES II? 

A. Not necessarily. 

Q. So the documentation may exist, you wouldn't 
necessarily know? 

A. That's correct. 

Q. Can you give me an example of an area in which 
you did not see sufficient documentation? 

A. I can't give you an example of an area in which 
I did not see documentation. 

Q. Sufficient documentation to comply or follow the 
guidelines? 

A. Not off the top of my head, no. 

Q. And I'll ask the same questions with respect to 
NHANES. To what extent did NHANES fail to follow 
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these guidelines? 

A. I don't know. I did not look at NHANES from 
that perspective. 

Q. To what extent did BRFSS in Minnesota fail to 
follow these guidelines? 

A. Same answer. 

Q. Just so the record is clear, why don't you tell 
us what NHANES is. 

A. NHANES is a nutrition survey conducted by the 
Health Interview — by the National Center for Health 
Statistics. 

Q. I'm referring to the National Health and 
Nutrition Survey — 

A. Yes. 

Q. — by NHANES? 

A. Yes. 

Q. Dr. Verhalen, were these guidelines designed to 
apply to a report such as Professor of Doctorate 
Samet's expert report, in this case Exhibit 3501, 
that you have reviewed? 

A. That's not why the guidelines were developed. 

Q. Do you think it's appropriate to apply the 
guidelines to a report such as Exhibit 3501? 

A. It might be. 

Q. Then again it might not be? 
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A. Correct. It depends on how one was to use it. 

Q. Use what? 

A. The report. 

Q. If one wants to use the report as an expert 
report in litigation such as a lawsuit that we're 
involved in here between Minnesota and Blue Cross 
Blue Shield of Minnesota and the various tobacco and 
industry groups, is it your opinion that the 
guidelines would be appropriate to apply to the 
reported use for that purpose? 

A. Unofficially they might be, but that's not why 
they were developed. 

Q. As you reviewed Dr. Samet's report. Exhibit 
3501, did you find any instance in which he failed to 
follow these guidelines? 

A. Not off the top of my head, no. 

Q. Do you have a general recollection that he 
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failed to follow the guidelines in any way? 

A. I suppose if I wanted to be real persnickety I 
could say that when documents are simply referenced 
by number and not by title or included, that might be 
considered less than adequate documentation, but I 
really didn't look at it from that perspective. 

The guidelines were not — the criteria by which 
I decided on these, the guidelines are merely an 
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example of what was necessary to be felt for 
regulatory purposes. 

Q. You told me that if you wanted to be real 
persnickety you could say that Dr. Samet's report 
failed to follow the guidelines by referring to 
documents by Bates numbers rather than by title, 
correct? 

A. That's correct, if those are not articles that 
someone who was interested in them could get to for 
purposes of assessing the study. 

Q. If instead of wanting to be real persnickety, 
you just wanted to be fair can you tell me of any way 
in which you noticed that Dr. Samet's report. Exhibit 
3501, didn't follow the guidelines? 

A. As I said, not off the top of my head, no. 

Q. Would your answers be the same with respect to 
the report prepared by Drs. Zeger, Wyant and Miller, 
Exhibit 2321? 

A. Would my answer be the same? 

Q. Yes. 

A. Yes. The guidelines were not the measure by 
which I was making this. Reference to the guidelines 
was simply to refer to the fact that any research 
should be fully documented as much as possible so 
that anyone reviewing could explore any possible 
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avenue to ensure that the study is justified in its 
conclusions. 

Q. Do you know if Drs. Zeger, Wyant and Miller in 
their work in preparing they're work. Exhibit 2321, 
adjusted for any significant differences in the NMES 
data between the national data and the data gathered 
in the midwest region? 

A. Would you repeat the question? 

MR. LOVE: Would you read it? 

(Record read.) 

THE WITNESS: I can't give you 
specifics, but I believe they did in some cases, yes. 
BY MR. LOVE: 

Q. Did they do so in an appropriate way? 

A. I can't answer that just off the top of my head. 
I would have to review the document. 

Q. Do you recall seeing in any way in which they 
made an adjustment that was not appropriate? 

A. Not offhand. 

Q. If you'll turn to your expert report. Exhibit 
3301, and I'm looking at page 7. 

A. 7? 

Q. Yes. The summary of opinions. Do you have that 
there, sir? 
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Yes. 


STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

234 

09:21:29 1 Q. Looking at the fourth bullet point, would you 

09:21:34 2 read that sentence to yourself? 

09:21:36 3 A. Okay. 

09:21:44 4 MR. BORMAN: Are you talking about 

09:21:46 5 page 7, summary of opinions? 

09:21:50 6 MR. LOVE: Yes. 

09:21:50 7 BY MR. LOVE: 

09:21:50 8 Q. My first question. Dr. Verhalen, is really that 

09:21:58 9 it seems to me there might be some typographical 

09:22:00 10 error in that sentence in that it refers to survey 

09:22:04 11 data employed in the model used by Minnesota to 

09:22:07 12 construct its model. 

09:22:08 13 That use of the word model twice, is that 

09:22:11 14 intentional? 

09:22:12 15 A. No, and it's not typographical. It's probably 

09:22:16 16 just a semantic problem when I was — 

09:22:19 17 Q. Can you tell us what you meant to say? 

09:22:22 18 A. In the data used by Minnesota to conduct its 

09:22:25 19 model would probably be a better way to say that. 

09:22:31 20 Q. So if we took out the words employed and the 

09:22:35 21 model and — 

09:22:36 22 A. And make it employed by the data used by 

09:22:40 23 Minnesota to construct its model. 

09:22:42 24 Q. I'm just trying to read what I thought you said, 

09:22:45 25 and if you can tell me if I'm mistaken, if we took 
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09:22:50 1 out the words employed and model it would read there 

09:22:53 2 are several logical flaws and scientific flaws from 

09:22:57 3 an epidemiological viewpoint in the survey data used 

09:23:02 4 by Minnesota to conduct its model; is that fairly 

09:23:09 5 stated? 

09:23:09 6 A. Yes. I guess a better way to have said that 

09:23:16 7 would be employed in the surveys or studies used by 

09:23:20 8 Minnesota to construct its model, because otherwise 

09:23:23 9 we're using the data more than once. 

09:23:33 10 There are several studies in the survey data 

09:23:42 11 employed in the studies used by Minnesota to 

09:23:44 12 construct its model. 

09:23:54 13 Q. Thank you. Did you find such flaws in the NMES 

09:24:17 14 data? 

09:24:17 15 A. Yes. 

09:24:55 16 Q. Under the flaws that you found discussed on 

09:24:59 17 pages 15 through 17 of your report it's — page 15 is 

09:25:13 18 the one that's called NMES data? 

09:25:33 19 A. I'm sorry. Would you repeat your question? 

09:25:36 20 Q. Sure. Are the flaws that you found in the NMES 

09:25:40 21 data discussed in pages 15 through 17 of your report? 

09:25:44 22 A. Yes. 

09:25:45 23 Q. Are there any flaws in the NMES data that you 

09:25:49 24 found that are not discussed in pages 15 through 17 

09:25:53 25 of your report? 
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09:25:53 1 A. There may be. I didn't discuss everything that 

09:25:56 2 I found on it. Given the constraints on time, I was 

09:26:01 3 sort of hitting the highlights. 
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4 Q. Can you tell me today about any flaws that you 

5 found in the NMES data that aren't discussed in your 

6 report? 

7 A. Not offhand. 

8 Q. Did you find flaws in the NHANES data? 

9 A. No. 

10 Q. Did you find flaws in the BRFSS data? 

11 A. Yes, I did. 

12 Q. Where are they discussed in your report? 

13 A. They're not specifically discussed in here I 

14 don't think. I did not specifically discuss the 

15 report. 

16 Q. Did you discuss the Minnesota BRFSS data in 

17 performing your work in this case? 

18 A. I just recently reviewed some that was given to 

19 me yesterday. 

20 Q. Was that the first time you reviewed any 

21 Minnesota BRFSS data? 

22 A. Yes, but this is even not specific BRFSS data. 

23 But I did look at Minnesota in comparing to the other 

24 states for prior years. 

25 Q. Without reviewing Minnesota BRFSS data how did 
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1 you find flaws in it? 

2 A. The Minnesota BRFSS data as I said earlier come 

3 from one of the smaller states that were participants 

4 in the BRFSS, and as a consequence should have had a 

5 far larger sample of people interviewed in order to 

6 get much confidence in their data. 

7 Q. Far larger a sample than what? 

8 A. Than was evident in what they were giving. Most 

9 of the smaller states in various studies that have 

10 been made of BRFSS who had inadequate samples to 

11 provide high confidence in the data from the survey. 

12 Q. Other than the size of the Minnesota BRFSS 

13 sample did you find any other logical or scientific 

14 flaws in that data? 

15 A. Not offhand. There may have been, but I don't 

16 recall any right offhand. 

17 Q. Let's turn to page 15 of your report where you 

18 discussed the NMES data in more detail. Now, 

19 yesterday we talked about the memory decay problem. 

20 Is there anything more about the memory decay 

21 problem that you've found that we didn't talk about 

22 yesterday? 

23 A. I don't think so. We probably pretty well 

24 covered it yesterday. 

25 Q. And you ultimately concluded that memory decay 
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1 would not be a significant problem for answering the 

2 question for a person who had smoked so long as the 

3 person had smoked for at least a year, correct? 

4 A. That's correct. 

5 Q. And you also conclude that memory decay would 

6 not be a significant problem for people answering the 

7 question whether they were currently treating for one 

8 of the major attributable diseases that are listed in 

9 the reports of Drs. Samet, Zeger, Wyant and Miller; 

10 is that correct? 
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A. I'm not so sure I would agree with that because 
I think our conversation revolved around the fact 
that there was inconsistency in what was reported by 
the individuals and what was reported by the 
physicians of people who were under treatment. 

Q. Dr. Verhalen, I'll show you attachment B to 
Exhibit 2321. It's the list of major smoking 
attributable diseases from the Zeger, Wyant, Miller 
report. 

My question is, do you believe that memory decay 
would be a problem in a person answering a question 
as to whether they were currently treated for any of 
those diseases? 

A. I think we agreed yesterday that I agreed with 
you, that it might not be, but again, I would have 
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said might not be because even a condition as 
significant as atherosclerosis did have a very low 
correlation. 

Q. Is it your understanding that NMES asked the — 
its interviewees, the patients, the same questions 
about their disease that they asked the physicians or 
looked for the medical records? 

A. For all practical purposes I believe that's true. 
Q. Isn't it true that the question asked of a 
medical care provider was specifically asked about a 
particular visit that the patient had to that medical 
care provider and what they were treated for on that 
visit? 

A. I don't recall. 

Q. If that were the case could that explain 
somewhere all of the lack of correlation between the 
self reporting of disease and the medical provider 
reporting of disease in NMES? 

MR. BORMAN: Object to the form. 

THE WITNESS: I don't think so. 

BY MR. LOVE: 

Q. Why not? 

A. Simply because even with the case of heart 
attacks that you would expect people to remember 
fairly well, you would expect a higher degree of 
STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

240 

correlation between what is reported between the 
medical care provider and the victim, and even there 
the correlation was only at about thirty-nine 
percent. 

Q. Other than the lack of correlation that you 
have discussed between the self reporting of disease 
and the medical provider report of disease do you 
have any other basis for saying that self reporting 
of disease is a significant flaw in NMES? 

A. No. I think there the situation speaks for 
itself; the lack of the correlation on major 
significant medical problems is in and of itself 
sufficient. 

MR. LOVE: Would you mark this? 
(Plaintiffs' Deposition Exhibit No. 3308 - article - 
marked for identification.) 

BY MR. LOVE: 
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Q. Dr. Verhalen, I'll show you what we have marked 
as Exhibit 3308, an article from the American Journal 
of Public Health, the first sort of cover page of 
that journal issue, and it has behind it the article 
entitled Health Insurance and Subject Health Status 
Data from the 1987 National Medical Expenditure 
Survey. I'll ask if you've seen that before. 

A. I think I have. I'm not sure. 
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Q. If it assists you. I'll point out that it was 
one of the articles listed in your — I believe it's 
called the Minnesota bibliography under tab 6 of your 
report. 

Would you turn to 1298 of the article? The page 
number is on the lower bottom end of the pages. 

You will see at the bottom of the first column 
the article talks about the NMES self administered 
questionnaire to assess subject health status. Do 
you see that? 

A. Yes. 

Q. The second sentence of that paragraph states 
that the methodology of self assessed health status 
is well grounded. Do you agree with that? 

A. I think that it's a much used technique. It 
is — whatever is meant by well grounded there, I'm 
not sure. 

Q. Would you say that the use of self — the 
methodology of self assessed health status is a 
standard used in epidemiological studies? 

A. It's a frequently used method for — based 
largely on the cost of administering surveys. 

Q. Is it a standard method? 

A. I don't know that it's a standard method. It's 
a frequently used method, so is personal interviews. 
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Q. Is it a non-standard method? 

A. It may be standard for some people, it may not 
be standard for others. 

What I'm saying is that there are a number of 
ways to conduct interviews. The cheaper way than 
having personal interviews by interviewers, by 
professional interviewers, is to have self 
administered questionnaires. 

So in that sense one might consider it standard, 
but if one sets a higher standard on being able to 
ensure that an individual understands a question when 
one answers the question, the better course is to 
have a professional interviewer. 

Q. If health status questions are asked by a 
professional interviewer either in person or by 
telephone is that a standard method of gathering data 
for epidemiological studies? 

A. If this is the tactic you're going to take then 
I would say yes to all of the above; they're all 
standard methods. 

Q. Is that a well grounded method for gathering 
data in epidemiological studies, having an 
interviewer ask about the interviewee's health 
status? 
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A. Can you define for me what you mean by well 
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grounded? 

Q. Something that's generally accepted in the field 
of epidemiology. 

A. By some people, yes. 

Q. When I say "generally accepted," I mean by 
the — in the field; not by some people in the field, 
but by the field in general. 

A. One might say generally accepted without 

implying that absolutely everyone in the field would 
accept that. If that's the definition, yes. I'll 
accept that. 

Q. The next sentence that says besides being a 
sensitive measure of the severity of current 
morbidity, subjective health status is a powerful 
predictor of future morbidity and mortality. Do you 
agree with that statement? 

A. Not necessarily. 

Q. Why not? 

A. Because again, I haven't a great deal of 

confidence in self administered questionnaires. 

Q. Do you know whether generally in the field of 
epidemiology self reported health status is regarded 
as a sensitive measure of the severity of current 
morbidity? 

A. I can't speak for the field of epidemiology. I 
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can speak for myself. 

Q. So you don't know whether that's something that 
generally is believed in the field of the 
epidemiology, work field? 

A. I know it is widely used. 

Q. But you don't know if it's generally accepted? 

A. I don't know. I can say that many people accept 
it, probably a substantial number don't. 

I don't necessarily accept it, depending on the 
questions being asked and how likely they are to be 
accurately interpreted and responded to. 

Q. Do you know whether the majority of 
epidemiologists accept it? 

A. I've never polled the epidemiologists. 

Q. But based on your many years in the field? 

A. I couldn't say whether the majority of 

epidemiologists accept it. 

Q. I take it your answers would be the same with 
respect to self assessed health status is a powerful 
indicator of future morbidity and mortality. 

A. That's correct. 

Q. Have you had discussions with other 
epidemiologists about the use of self reported health 
status in epidemiology? 

A. From time to time in years past, yes. 
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Q. What was the substance of those conversations? 

A. What was the substance of the conversations? 

Q. Right. 
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A. Where we're not self reported questionnaires, we 
would listen to the kind of response we were looking 
for. 

Q. In a particular study or survey? 

A. Yeah, most often. Since that was the majority 
of my career, it dealt with the area of trauma 
epidemiology. 

Q. What type of questions were you considering 
asking? 

A. We were asking a number of questions, for 
example, about how incidents occurred, how accidents 
occurred, how often somebody used products; all of 
the questions that were going in to assessing whether 
products were in some way worthy of the Commission 
supplies and take a closer look. 

Q. Did you choose to use any self reported 
information in that regard? 

A. We ultimately decided we had to because we 
didn't have the resources to do it the way we would 
have preferred. 

Q. At the top of page 16 of your report continuing 
with your discussion of NMES data you talk about 
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something called digital preference; is that correct? 
A. At the top of the page? 

Q. Top of page 16. 

A. Yes. 

Q. How did digital preference affect, if it did, 
the way in which Drs. Zeger, Wyant and Miller used 
NMES data? 

A. I'm not saying specifically how it did because 
I'm not sure that it did. I'm just saying that 
whenever you're asking people for specific numbers, 
whether you're talking about age, whether you're 
talking about number of cigarettes smoked, whether 
you're talking about number of visits to a physician 
or anything else, that quantifying digital preference 
may be a problem. 

Q. But you're not saying that it was actually a 
problem in Drs. Zeger, Wyant and Miller's use of NMES 
data? 

A. Not necessarily. It could have been. 

Q. Other than age can you think of any data that 
Drs. Zeger, Wyant and Miller used that would even be 
subject to digital preference because of this digital 
information? 

A. I would have to review the document again. 

There are a number of areas where they're asking for 
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quantifications. 

Q. Can you think of any today other than age? 

A. Not just offhand. 

Q. At the end of that paragraph that started or 
continued at the top of page 16 you stated that any 
estimates relying on this type of data cannot be 
considered reliable. Do you see that? 

A. Yes. 

Q. Is it your opinion that no reliable estimates 
can be made on self administered health status 
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questionnaires? 

A. It's my opinion that reliability would vary as a 
function of people's ability to understand and 
properly respond to the questions. 

Q. Well, you state, don't you, that any estimates 
relying on this type of data cannot be considered 
reliable? 

A. That's correct. 

Q. Does that mean that no reliable estimates can be 
made relying on self administered questionnaire data? 
A. I think that's correct. 

Q. And is that apart from your causation concerns? 
A. Yes. The degree to which you would want to set 
your reliance would be a function of the use to which 
you were to put the data. 
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Q. Does that mean that you can estimate some things 
using self administered health questionnaires 
reliably, but not other things? 

A. It means that you can estimate about anything 
using self administered questionnaires, but that the 
level of reliableness would be a function of the use 
to which you were going to put the data. 

So in that sense it may be less reliable in some 
circumstances than in others. 

Q. To what extent did NMES rely on self 
administered health status questionnaires? 

A. It relied on it very heavily in the development 
of the smoking attributable fractions of diseases 
used to compute the costs. 

Q. My question was, to what extent did NMES use 
self administered health status questionnaires. I 
don't believe NMES calculated smoking related — 

A. No, it didn't. 

Q. To what extent did NMES use health administered 
health status questionnaires? I'm talking about NMES 
II in all these questions, the 1987 version. 

A. I would have to look at it again. I can't give 
you the specific answers. 

Q. You understand that NMES did use telephone 
interviews as well? 
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A. That's correct. 

Q. To that you're just telling me you're not sure 
today to what extent they used health status 
questionnaires versus telephone interview 
questionnaires? 

A. The one that comes first to my mind is the self 
administered health questions on smoking behavior. 

Q. In the first full paragraph on page 16 that 
takes us to about the second half of the page you 
discuss what you call poor correlation between the 
subject self reported disease information and the 
health care provider reported disease information, 
correct? 

A. Yes. 

Q. And at the bottom of the page are you saying 
that one can't rely on the medical provider 
information about the subject's disease status 


http://legacy.library.ucsf Sdur'tiel/NhStiiffi^tSa/pdilhdustrydocuments.ucsf.edu/docs/tzgd0001 



0 

9 

52 

01 

18 

0 

9 

52 

05 

19 

0 

9 

52 

07 

20 

0 

9 

52 

13 

21 

0 

9 

52 

15 

22 

0 

9 

52 

17 

23 

0 

9 

52 

19 

24 

0 

9 

52 

25 

25 


09:52:29 

1 

09:52:32 

2 

09:52:36 

3 

09:52:37 

4 

09:52:39 

5 

09:52:48 

6 

09:52:50 

7 

09:52:54 

8 

09:52:57 

9 

09:52:59 

10 

09:53:02 

11 

09:53:03 

12 

09:53:04 

13 

09:53:11 

14 

09:53:16 

15 

09:53:20 

16 

09:53:21 

17 

09:53:23 

18 

09:53:27 

19 

09:53:32 

20 

09:53:36 

21 

09:53:42 

22 

09:53:45 

23 

09:53:46 

24 

09:53:46 

25 


09:53:55 

1 

09:53:59 

2 

09:54:06 

3 

09:54:08 

4 

09:54:10 

5 

09:54:11 

6 

09:54:15 

7 

09:54:20 

8 

09:54:23 

9 

09:54:27 

10 

09:54:30 

11 

09:54:35 

12 

09:54:37 

13 

09:54:41 

14 

09:54:45 

15 

09:54:47 

16 

09:54:52 

17 

09:54:58 

18 

09:55:01 

19 

09:55:05 

20 

09:55:08 

21 

09:55:11 

22 

09:55:17 

23 

09:55:22 

24 


either? 

A. I'm saying that even the medical provider 
information is not necessarily always a — is not 
always correct or factual. 

Q. In your opinion is the medical provider 
information reliable? 

A. Reliability is a function, again as I said 
earlier, of how you intend to use it, the level of 
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reliability that you acquire, and if you're using it 
in a general sense to give general program guidance 
it's probably adequate. 

If you're using it very specifically for 
purposes of assigning costs with an eye towards some 
very specific measure, it may not be reliable enough. 
Q. When you say "it may not be reliable enough," is 
it your opinion that it may be or it may not be, you 
just can't tell me which one it is? 

A. In this particular case for this use I don't 
think it's reliable enough. 

Q. Why not? 

A. Because it is not necessarily correct. 

Q. What degree of reliability do you demand of data 
for the purposes Drs. Zeger, Wyant and Miller are 
using? 

A. I would require a very high degree of 
reliability, but I can't give you a figure. I would 
want to sit down to give that consideration. 

Q. Yesterday we talked briefly about decisions made 
by engineers, for instance, and their use of 
statistical information in making those decisions, 
correct? 

A. Yes. 

Q. Isn't it also true that the medical profession 
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uses statistical information to make decisions about 
what type of care or procedure to use in treating a 
patient? 

A. An individual patient? 

Q. Yes. 

A. It may be used by some practictioners with an 
eye toward being able to give the victim a 
probability of outcome. 

Q. Let me just take one hypothetical example and 
see if we can talk it through. 

If there may be some condition for which surgery 
is available as a treatment and, in fact, there might 
be two different surgical procedures that could be 
used to address this condition, and statistics may 
have been gathered on the use of those two different 
procedures over time, and analysis performed on the 
statistics shows that procedure A has a higher 
probability of a favorable outcome than procedure B 
for people in certain age groups and gender groups 
and so on, okay? 

A. Yes, I understand. 

Q. Wouldn't it be fair for a surgeon to use that 
information in deciding which procedure, A or B, to 
use on a given patient? 
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MR. BORMAN: I'll object to the form. 
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THE WITNESS: I don't know if it would 
be fair. Undoubtedly he would do it because he has 
what is in his mind the potential litigation that he 
may face if he's wrong, as well as he may be very 
concerned about the individual outcome for the 
patient. 

On the other hand, as I've said, that's a 
decision that if there is a substantial difference 
between two kinds of things, the patient in my view 
should probably be notified. 

Secondly, most statistics of which I'm 
aware, and I'm not aware of all of them, of this type 
would usually be used upon a reasonably large census, 
collection of data, of all similar cases that have 
been documented with literature rather than a survey 
of some population just to see what the estimates 
might be. 

BY MR. LOVE: 

Q. Return back to page 7 of your report, the 
summary of opinions. Before we do that. Dr. 

Verhalen, we have just been discussing the items that 
you addressed on pages 15 and 16 of your report, 
correct? 

A. Yes. 

Q. Are there any other logical or scientific flaws 
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that you found in the NMES data that we haven't 
discussed yet? 

A. There very well may be. I would have to go 
through them again to decide. I said what I was 
covering here was, as I said, exemplary information. 

Q. Can you tell me today whether there are any other 
logical or scientific flaws in the NMES data besides 
what we have discussed today? 

A. I'm confident there are. 

Q. Can you tell me what any of them are? 

A. Not just off the top of my head. 

Q. And even though you prepared for today's 
deposition as you told me yesterday you're unable to 
give me any other logical or scientific flaws in the 
NMES data that we haven't discussed; isn't that 
correct? 

A. Off the top of my head, that's correct. 

Q. Back on page 7 the fifth bullet point states 

that there are times when appropriate conditions 
exist when national data can be used at the state 
level. What times are those? 

A. As I said on page 17 of the report under the 
portion entitled synthetic estimation, I say that 
they can be used when and only when the national 
sample takes into account the statistical 
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representativeness of each stage sub-sample 
population at the level to which it's going to be 
extrapolated; that is to say that when the national 
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sample is drawn, it must take into account the 
statistical representation of each state in that 
sample for which they're going to be able to make 
estimates to ensure that each state is appropriately 
represented. 

Q. Does that mean that the national sample has to 
contain enough information from a given state to 
allow for direct estimation? 

A. I think it does, yes, when it involves an issue 
of this nature. 

Q. Are there any other times when it's appropriate 
to use national data at the state level? 

A. Certainly when it's less important, but also the 
degree of precision with which you're going to try to 
make those estimates may be a little less rigorous. 

Q. Because the NMES survey was not conducted in a 
way to identify a sufficient number of respondents 
from Minnesota to allow for direct estimation; is it 
your opinion that that's why NMES cannot be used to 
make a state estimate? 

A. Because NMES was designed for general policy 
guidance with an eye toward such — targeted to a 
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specific use to which it's being made in the 
Minnesota litigation; I think it is inadequate in its 
representation, that's correct. 

Q. Dr. Verhalen, on pages 11 and 12 of your report 
you have a further discussion of NMES; is that 
correct? 

A. Yes. 

MR. LOVE: Why don't we take a five 
minute break and I'll get my documents together. 
(Recess taken.) 

MR. LOVE: Keith, maybe you want a 
housekeeping matter on the record. I have not asked 
Dr. Verhalen questions about any conversations he's 
had with you or any of the attorneys in this case or 
the Mississippi case or Texas case because I assume 
you would object to attorney work product. 

I understand plaintiffs have objected the 
same objections with their experts, but I do want to 
state, I don't know whether that's the subject of 
another discussion between the two parties as to 
whether that's proper or not, and if it turns out 
that the Court should ever decide that those types of 
questions should be answered by both sides, I would 
like to pose those questions of Dr. Verhalen by 
asking them all without you having to object every 
STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

256 


time. 


MR. BORMAN: I guess that would have 
to be worked out as part of the Court's order. If 
the Court deems that all the depositions be open for 
those questions then — 

MR. LOVE: What I'm asking is that we 
agree whether it makes no difference whether I ask 
Dr. Verhalen all those questions today and having you 
instruct him not to answer or not. 

MR. BORMAN: That's my understanding 
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of the position the parties are taking. That is 
something that I understand will be taken up with the 
Court. 

MR. LOVE: That's why I asked because 
I've heard that it has. 

MR. BORMAN: Perry is our local man 
and he's not in the room right now, but that 
certainly is what I understand is going to happen. 

BY MR. LOVE: 

Q. So we were looking at pages 11 and 12 of your 
report and your discussion of NMES on those pages. 

A. Yes. 

Q. You state on page 11 that the primary goal was 
to provide national estimates for the use of 
expenditures for health services and of health 
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insurance coverage among the civilian 
non-institutionalized population of the United 
States, right? 

A. That's correct. 

Q. Would you also agree that NMES - and all my 
questions are about NMES II, the 1987 version - was 
designed to provide a larger representation of 
certain population groups including poor and low 
income families so that they could be analyzed? 

A. Yes. 

Q. Would you agree that poor and low income 
families are the — include the types of people who 
are most likely to be Medicaid recipients? 

A. Yes. 

Q. And would you agree that NMES can be used to 
analyze and make estimates of the use of an 
expenditure for health services for the United States 
population of Medicaid recipients? 

A. Yes. 

Q. Do you agree that there are more similarities 
between Minnesota Medicaid recipients and national 
Medicaid recipients than there are between the 
Minnesota population generally and the national 
population generally? 

A. No, I don't know that. 
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Q. You don't know one way or the other whether 
there is more similarity between the first comparison 
group and the second comparison group? 

A. No, I really don't. 

Q. So the fact that the first comparison group were 
comparing both between Minnesota and the nation are 
all from families with — would be poor or have 
either low income wouldn't increase the similarity 
between that Minnesota group and that national group? 
A. You're going to have to give me that question 
again. I didn't follow you. 

Q. When we compare Minnesota Medicaid recipients to 
national Medicaid recipients we're generally 
comparing people from poor or low income families, 
correct? 

A. Yes. 

Q. And the fact that we have restricted our groups 
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to people in poor or low income families wouldn't 
make those groups more similar than we would without 
that restriction, namely the entire Minnesota 
population and the entire nation population? 

A. Not necessarily. 

Q. Does over-sampling of poor and low income 
families have any effect on the ability to make a 
state estimate with respect to poor and low income 
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families? 

A. I don't think it does, no. 

Q. If you turn to page 12 of the first full 
paragraph on that page. What was your basis for 
stating that budget constraints forced the NMES 
framers into the particular design that they chose? 

A. Statements within the NMES documents. 

Q. Can you identify any NMES document with such a 
statement? 

A. Yes. Methods 3, third or fourth page, they 
refer to that or maybe it's the second or third page. 
If you let me take a look at it I think I can find it 
for you. 

Q. Dr. Verhalen, I would be happy to do that. My 
difficulty is I don't have a clean copy of Methods 3 
with me. 

I do have a copy in which I made highlighting 
and I don't want to mark that as an exhibit. I don't 
think it's appropriate. 

I'm trying to see if there is some way I can 
help you and address my concerns as well. 

A. Suffice it to say, there is a statement early 
in the document where they talk about the rationale 
behind doing a split sample and it mentions budget 
constraints. 
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Q. Let me just read you one portion to see if this 
refreshes your recollection at all. This is on the 
first page, page 1 of the Methods 3. 

There is a heading called Sample Design and it 
states the analytical goals of the national medical 
expenditure survey and budget constraints require 
that the sample designed meet the following 
requirements, and it has four bullet points. 

It talks about doing interviews on a full series 
of interviews on fourteen thousand households. The 
sample size should be spread out over at least a 
hundred separate areas, that it should produce 
approximately unbiased national estimates and 
estimates of adequate decision for the four census 
regions, and that it should meet predesigned 
precision specifications for populations, blacks, 
Hispanics, the poor, near poor, sixty-five and over, 
persons limited in activities of daily living. 

Does that refresh your recollection as to the 
part of Methods 3 that was the basis for the 
statement in your report? 

MR. BORMAN: I'm going to have to 
object. I understand you've got a problem, but I 
think it's really inappropriate to ask him to comment 
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on a document when it's available and he can't look 
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at it. 


MR. LOVE: Maybe we can make a copy of 
this over break. 

MR. BORMAN: Why don't you let him 
look at it at least without making it as an exhibit. 

MR. LOVE: That's fine if we just 
limit it to this page now. 

MR. BORMAN: Certainly. 

BY MR. LOVE: 

Q. I'm happy to find a way we can accommodate you 
on this. There it is. 

A. Yes. This is one place where it mentions it. 
There are several other places in the documents that 
I have reviewed where it goes on to elaborate on this 
mentioning it several times. 

Q. Mentioning what? 

A. Mentioning budget constraints that forced them 

in to the sampling design that they took. This is 
where I first saw it. It appears elsewhere 
throughout the NMES documents. 

Q. Do you believe that NMES should have sampled 
more than fourteen thousand households with a full 
series of interviews? 

A. I don't know what their samples should have 
been, but it probably should have been larger, yes. 
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Q. Why do you say it should have been larger? 

A. Because that would be the net result of doing 
what I think would be necessary to make it relevant 
for estimation downward. 

It would include representative portions of each 
and every state included in the national samples. 

Q. Do you have any understanding as to why choosing 
two data collection organizations was a factor of 
budget constraints? 

A. I seem to recall some mention in there that that 
was also a part of the budget consideration. I don't 
remember the precise wording. 

Q. Do you have any idea why choosing two 
organizations would cost less than choosing one 
organization? 

A. Logistics and control. Each one would have its 
own portion of a sample. 

Q. And that would cost less than having a single 
organization do the data? 

A. It could, yes. 

Q. In your opinion would it have been better if 
NMES had a single data collection conduct the survey? 
A. Yes, because when you have two different data 
organizations collecting data there is no assurance 
they are going to apply absolutely identically 
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against the nation, and if the intention to aggregate 
the data for use, you're just adding one more 
potential for error. 
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Q. You go on in this paragraph of page 12 of your 
report to say unbiased national estimates were 
sought. Do you see that in about the middle of the 
paragraph? 

A. Yes. 

Q. Was NMES designed to provide unbiased national 
estimates? 

A. That was their purported goal. 

Q. In your opinion did they succeed in providing unbiased 
national estimates? 

A. I can't say they would be unbiased any more than 
any sample would be unbiased, but they probably have 
determined what the directions of those biases are 
and what the degree of biases that exists. 

Q. That's information then that would be available 
to anyone using the NMES data? 

A. I would presume. 

Q. At the bottom of that paragraph you state that 
among some eighty-four studies listed in plaintiffs' 
expert report to illustrate broad validity of NMES 
analysis at the state level was resounding the 
absent, correct? 
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A. That's what I said, yes. 

Q. Dr. Verhalen, did any of those eighty-four 
studies say that they would not apply at the state 
level? 

A. Not to the best of my recollection. 

Q. Dr. Verhalen, are you aware that methodologies 
have been published that take large area data and 
apply them for small area estimates? 

A. Yes. 

Q. And leaving aside direct estimation do you 
believe that that's — that that taking of large area 
data and using it to establish a small area estimate 
is appropriate at times? 

A. I believe it's appropriate if the smaller areas 
to which it is to be applied are a sufficient sample 
to be directly applied downward, yes. 

Q. That would be a direct estimate, wouldn't it? 

A. I said if the sample were sufficiently large to 
permit a direct estimate. I didn't say to do a 
direct estimate. 

Q. So you might be able to make a small area 
estimate from a large area survey using some 
procedure other than direct estimation as long as 
there was enough data in the large area survey to do 
a direct distinction of the — 
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A. As long as a large area data base included a 
suitable representative sample of the smaller area to 
which the estimate is to be applied. 

Q. Could that include situations in which there 
would not be enough data in the large area survey to 
perform a direct estimate of the smaller area? 

A. I doubt that. 

Q. I should probably ask that question a different 
way. Would that include situations in which the data 
from the large area survey did not include enough 
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data from the smaller area to allow a direct estimate 
of the smaller area? 

A. Probably not. 

MR. LOVE: Let's mark this. 

(Plaintiffs' Deposition Exhibit No. 3309 - article - 
marked for identification.) 

BY MR. LOVE: 

Q. Dr. Verhalen, I'll show you what we have marked 
as Exhibit 3309, an article of the Journal of the 
American Statistical Association entitled A Model 
Based Approach to Estimation for Small Sub-Groups of 
a Population. 

I'll show this to you and tell me if that was 
another one of the articles in your Minnesota 
bibliography. 
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A. Yes, it is. 

Q. It was number 142. Have you read that article 
before? 

A. Yes, I have. 

Q. If you look at the conclusions on page 409 of 
that article in the middle of the first paragraph of 
the conclusions the authors state that we have 
considered some simple models, but other more complex 
models including regression models similar to those 
employed by Erickson may also be chosen. Do you see 
that? 

A. Yes, I do. 

Q. Is it your understanding that they're saying 
that there are regression models that can be used to 
make small area estimates from large area surveys? 

A. That's what the author is saying, yes. 

Q. In the second paragraph on the conclusions, 
would you read that to yourself? 

A. Okay. 

Q. Do you agree with that conclusion? 

A. I'm not a statistician, but while I may agree 

with his conclusions, that doesn't even mean that 
it's necessarily acceptable to everyone. 

There is a level of imprecision that concerns me 
when we get to small estimates. 
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Q. Have you discussed the methods described in this 
article for making small area estimates from large 
area surveys with anyone else? 

A. No, I haven't. 

Q. Do you agree that there are established 
statistical methods for answering the many important 
practical problems that arise in making small area 
estimates from large area surveys? 

A. I believe there are many methods that have been 
developed which address the question. The 
acceptability of them is subject to wide variation 
among statisticians, just as most statistical 
arguments are. 

Q. Do you have your own opinion as to the 
acceptability of those methods? 

A. I don't accept them. 

Q. You don't accept them? 
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A. That's correct. 

Q. Why not? 

A. Given the — I don't accept them without the 
limitations I mentioned earlier, that synthetic 
estimation is appropriate only when you're dealing 
with a representative sample in the smaller — in a 
smaller group to which you're going to be making 
estimates. 
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The degree to which this becomes problematic is 
a function, again, of the use to which the data are 
to be put. 

If they're going to be used only for general 
policy guidance, I would have less of a problem 
because the downsize of being wrong is not quite so 
onerous. 

MR. LOVE: Would you mark this? 

(Plaintiffs' Deposition Exhibit No. 3310 - article - 
marked for identification.) 

BY MR. LOVE: 

Q. Dr. Verhalen, I'll show you what we have marked 
as Exhibit 3310, an article from the Journal of 
Economic and Social Management titled An Application 
of Small Area Estimation Techniques to Derive State 
Estimates of Health Insurance Coverage from the 1987 
NMES. I'll ask if you've seen that before, sir. 

A. All right. 

Q. Have you seen that before, sir? 

A. Yes. 

Q. Had you seen it before Friday of last week? 

A. No, I don't think so. 

Q. So the first time you saw it probably was when 
we designated this document for your deposition; is 
that correct? 

STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

269 

A. Right. 

Q. The authors of this article are Jill Braden and 
Stephen Cohen. Do you see that? 

A. Yes. 

Q. Do you know that Stephen B. Cohen is the director of the 
Division of Statistics and Research Methodology for the 
Center for Intramural Research which is part of the 
Agency for Health Care Policy and Research? 

A. I didn't know that, but that's fine. 

Q. Are you aware that the Agency for Health Care Policy and 
Research is the agency that conducts and produces NMES? 

A. Yes. 

Q. On the second page of this article. Exhibit 
3310, in the first full paragraph the authors state 
that they briefly describe three techniques for 
producing small area estimates. Do you see that? 

A. Yes. 

Q. And then later on in that paragraph they say 
that they will produce state estimates of uninsured 
civilian non-institutionalized population using 
health care expenses for 1987. Do you see that? 

A. Yes. 

Q. It's true, isn't it that Drs. Zeger, Wyant and 
Miller used NMES to produce a Minnesota estimate of 
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the Minnesota Medicaid population, correct? 
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A. Yes, I believe so. 

Q. Are you familiar with any of the three 
techniques that the authors of this article described 
and they refer to, the first as the NCHS Synthetic 
Estimator? 

A. Where are you reading? 

Q. On page 2 at the — there is a heading called — 
second page of the article, but it's numbered page 
194. There is the heading Three Small Area 
Estimation Techniques. 

A. Your question is? 

Q. Are you familiar with the third statement, the 
NCHS Synthetic Estimator? 

A. I've seen estimates to the NCHS Estimator. 

Q. Have you ever used it? 

A. No. 

Q. Have you ever use discussed with anyone who has 
used it? 

A. No, I haven't. 

Q. Do you have an opinion whether the NCHS 
Synthetic Estimator is appropriate for making a state 
estimate from a national survey? 

A. Again, I think it would be appropriate in so far 
as it is able to provide estimates of sufficient 
precision based upon the representativeness of the 
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smaller area to which it is to be represented that it 
meets that I would consider the minimum requirement 
of precision for questions with major import as 
opposed to pure policy. 

Q. And your basic standard is that the national 
estimate would have to have sufficient data from the 
state to allow for a direct estimation? 

A. For the application to which it's being put 
here, yes. 

Q. On page 195 of the article the authors discuss 
the second technique called the Sample - Regression 
Estimator. Are you familiar with that? 

A. No. 

Q. I take it then you don't have any opinion about 
the use of what estimator since you're not familiar 
with it? 

A. Nothing that would deviate from what the 
general position of mine that I pointed out is, that 
the estimator must be capable of providing an 
estimate of sufficient precision in this application, 
and this does not suggest that it gives any greater 
precision than would any others. It's still got a 
rather large error attached to it. 

Q. I take it then your answer is really the same as 
what we talked about with the NCRS Estimator? 
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A. That's correct. 

Q. And on page 196 the third technique is called 
the Base Unit Estimator. Are you familiar with that? 
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4 A. Called a what? 

5 Q. Base Unit Estimator, the top of page 196. 

6 A. Same, same discussion. 

7 Q. Are you familiar with that estimator? 

8 A. No, I am not. 

9 Q. Do you know to what extent and whether Drs. 

10 Zeger, Wyant and Miller in preparing that report used 

11 any of those three estimators? 

12 A. I recall them saying that they essentially used 

13 a direct estimate. 

14 Q. And none of these three estimators described in 

15 the article in Exhibit 3310 is a direct estimate, is 

16 it? 

17 A. That's correct. 

18 Q. So I take it then it's your understanding that 

19 Drs. Zeger, Wyant and Miller did not make any use of 

20 these three estimators in their work? 

21 A. I don't recall having seen one, no. 

22 Q. Do you know if they used anything that was 

23 similar to one of these three estimators? 

24 A. I'm not a statistician. I can't talk about 

25 similarities. 
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1 Q. On page 13 of your report. Exhibit 3301, there 

2 is a quotation from NMES in the middle of the page. 

3 Do you see that? 

4 A. Yes. 

5 Q. And a few lines above that you're discussing 

6 what — I believe you're discussing what you did at 

7 CPSC when you had to commit specific dollar amounts 

8 to any of your projects; is that correct? 

9 A. That's correct. 

10 Q. What information did you use to commit specific 

11 dollar amounts to remedial projects? 

12 A. We used the NEISS data. 

13 Q. Isn't it true that the NEISS data is a broad 

14 national survey? 

15 A. Yes, it is. 

16 Q. After the quote from NMES on that page you state 

17 that the question is what would be adequate for 

18 specific commitments of resources of reliable damages 

19 estimate. You asked that rhetorical question, 

20 correct? 

21 A. Yes. 

22 Q. And then you say if no data set exists that is 

23 sufficient to give the information that you feel you 

24 need that such a data set must be created; is that 

25 right? 
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1 A. That's correct. 

2 Q. What data set would the State of Minnesota have 

3 to create in order to estimate the smoking 

4 attributable health care costs, leaving aside your 

5 causation objection which would never allow to you 

6 make such an estimate? 

7 A. I can't tell you off the top of my head. If I 

8 were to discuss that, I would want to really get into 

9 what the questions were that we were going to try to 
10 answer and spend some time developing. 
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Q. And in performing your work in this litigation 
did you ever consider what data would be needed to 
make those types of estimates? 

A. No. I considered what data were absent. 

Q. What absent data did you conclude would need to 
be gathered to make those types of estimates? 

A. This is what we have been discussing for the 
past two days; information on a very specific 
population for which we're trying to make the 
estimates in the State of Minnesota with a known 
error and — I could stop right there. 

Q. If we did the full NMES survey to fifteen 
thousand households in Minnesota would that give 
us the data we need to make the estimate leaving 
aside your causation concerns? 
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A. It might. 

Q. Can you tell me any reason why it might not? 

A. It would depend on how the questions were asked, 

whether they were asked in such a way that you were 
confident that the questions were being properly 
interpreted and answered properly. 

Q. Just as they were answered in NMES? 

A. It might. 

Q. And again. I'll ask you, can you tell me in any 
way why using the exact NMES questions that 
Minnesota might not provide the data that would be 
needed? 

A. I don't know if fifteen thousand households in 
Minnesota would be a proper size. I don't know what 
that size would be. I would have to sit down and 
consider it. 

Q. If we agree there is some size that the entire 
state that needs to be surveyed, correct? 

A. Yes. 

Q. And if we just assume we have got a size that 
you find to be adequate and we ask the exact NMES 
questions to this Minnesota survey of that size would 
we then have the data we need to make these 
estimates, leaving aside your causation concerns? 

A. These estimates. 
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Q. These estimates that Drs. Zeger, Wyant and 
Miller make in their report? 

A. I don't know. They might be. 

Q. Can you tell me any reason why they might not 

be? 

A. They might not be precisive. 

Q. The questions or the data? 

A. The data. 

Q. How precise would they have to be? 

A. I don't know. I would have to sit down and 

consider that. 

Q. Would you need to consult with a statistician to 
do that? 

A. I would undoubtedly consult with a statistician. 
Q. Would you turn to pages 14 and 15 of your report? 
A. Okay. 

Q. I'd like you to refer to the discussion at the 
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bottom of 14 and the top of 15 involving the lead 
paint example that you give. 

A. Yes. 

Q. While you were with the CPSC did it ever 
regulate the amount of lead in paint? 

A. It was charged with the responsibility for 
regulating the amount of paint which was imposed on 
it by the Congress. 
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Q. The amount of lead in paint, not the amount of 
paint? 

A. I'm sorry. The amount of lead in paint. 

Q. So CPSC regulated it at a level dictated by 
Congress? 

A. That's correct. 

Q. Did CPSC ever make a determination on its own as 
to what level if any it should — at which it should 
regulate lead paint? 

A. No, it didn't. The argument was that the CPSC 
could not come to a conclusion at what level lead in 
paint would be safe, therefore they chose not to 
regulate and that's when Congress imposed its will. 

Q. If Congress had not imposed its will is it fair 
to say that the CPSC would not have established any 
regulations regarding the amount of lead in paint? 

A. It's fair to say that in all likelihood they 
would not have, that's correct. 

Q. Would manufacturers then be free to use any 
level of leaded paint that they chose? 

A. Presumably, yes. 

Q. Did CPSC believe that lead was a significant 
cause of harm? 

A. What was the first word in your question; could 
they or did they? 
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Q. Did they conclude that lead was a significant 
cause of harm to people? 

A. A significant cause of potential harm, yes. 

Q. Did the CPSC also conclude that lead in paint 
was a significant source of lead exposure? 

A. No, they really couldn't. 

Q. Why was that? 

A. They could only conclude that it was a major 
source. 

Q. What's the difference between a major source and 
a significant source? 

A. Significant has a statistical connotation to 
meet. There are a variety of sources which lead — a 
variety of sources of lead which can lead to blood 
lead levels that are undesirable. 

Q. Why is it better to have no regulation of the 
amount of lead in paint than some regulation of that 
amount? 

A. I didn't say it was better. 

Q. Did you agree with the CPSC's conclusion that it 
did not have enough data to establish a safe level? 

A. I did. 

Q. Did you think it was best for the CPSC to 
establish an allowable level for lead in paint or to 
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not establish any level? 
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A. I didn't have an official position on that, 
but — other than as director of epidemiology, I felt 
that if we could not identify a safe level, you could 
probably be better to not try to identify a level 
because it implies safety, and people might be going 
forward with that notion that it is safe. 

Q. Prior to establishing a maximum level of lead in 
paint had the paint manufacturers been following some 
uniform standard? 

A. I don't know what their standard was. I know 
that lead was used in paint as a dryer and they would 
not want to put in so much lead that it would dry too 
quickly, nor so little that it wouldn't dry quickly 
enough. So I presume there was a standard. 

Q. When Congress did establish through the CPSC a 
maximum level of lead in paint was that higher or 
lower than the levels in the paint that was being 
sold at that time? 

A. Lower. 

Q. Was that so the manufacturers were required to 
reduce the level in the level that they were 
manufacturing? 

A. That's correct. 

Q. In your position at the CPSC did you have any 
opinion as to whether that would be a benefit to the 
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population? 

A. No. There was no way to know because we didn't 
know the source of lead poison in the population at 
large. 

We only knew that there were a variety of 
sources; paint was one of them, automobile emissions 
are another, and there were several others that were 
listed. I don't recall what they were. 

Q. Were there better limits on the amount of lead 
in automobile fuel existing at that time? 

A. I don't recall if there were at that time, but 
that was not an item under our jurisdiction. 

Q. After this maximum level of lead in paint was 
established do you know whether lead poison 
decreased? 

A. I have no idea. 

Q. Did the CPSC make any effort to determine that? 
A. No, we didn't. 

Q. Why not? 

A. It was a Commission decision not to. 

Q. Not your decision? 

A. Not my decision. 

Q. Is that information that you would have liked to 
have obtained? 

A. Not necessarily because my own view was the 
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chronic hazards were far more difficult to address 
with the limited budget our Commission had, and there 
were a sufficient number of acute hazards for us to 
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4 be worrying about. 

5 Larger agencies such as the EPA had budgets 

6 which could address this much more effectively. 

7 Q. Dr. Verhalen, let's continue our discussion with 

8 synthetic estimation which are on pages 17 and 18 of 

9 your report. 

10 At the bottom of page 18 you state the reliance 

11 on synthetic estimations procedures to construct 

12 estimates for smaller areas — I read that wrong. 

13 You state that reliance on synthetic estimation 

14 procedures to construct estimates for areas smallest 

15 than the lowest area for which a sample was designed 

16 also seems somewhat chancy; is that correct? 

17 A. That's correct. 

18 Q. What do you mean that it seems somewhat chancy? 

19 A. That it wasn't precise enough for the purposes 

20 to which the data were to be used. 

21 Q. How chancy is that? 

22 A. I don't know, but you would want to reduce the 

23 likelihood of being wrong to the lowest possible 

24 level where you're going to be taking major, what I 

25 would consider, Draconian steps to require payment 

STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

282 

1 based upon estimates which are in themselves 

2 inprecise from a variety of other perspectives as 

3 well before you can get to synthetic estimation. 

4 Q. What types of government agency decisions would 

5 you put at the same level in terms of needing 

6 precision as you do for making damages' estimates in 

7 this case? 

8 A. Probably any government agency which is 

9 addressing a specific problem that has major direct 

10 provable one for one impact on health or dollars. 

11 Q. If a government agency is deciding the relative 

12 amount of budget to put towards one health care issue 

13 versus another health care issue does that require 

14 the same degree of precision that you would require 

15 for the estimates in this litigation? 

16 A. No, I don't think so because it's easily 

17 correctable. 

18 Q. So in your opinion that wouldn't have a major 

19 effect on health, the decision of how much of a 

20 budget to put towards one issue towards another? 

21 A. Not necessarily because you can change your mind 

22 six months, a year, two years down the pike. You 

23 have not made an irreparable decision. 

24 Q. Can you give me an example of any decision that 

25 was made by the CPSC for which you required the same 
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1 degree of precision that you would like to require in 

2 this litigation for the estimates of smoking 

3 attributable health care costs? 

4 A. Again, probably only the Worm Probe issues which 

5 actually destroyed an industry. 

6 Q. Can you think of any other decisions of the CPSC 

7 or actions of the CPSC that required that same level 

8 of precision? 

9 A. I don't think so, no. 

10 Q. So it's your belief that the smoking 
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attributable health care estimates in the Zeger, 
Wyant, Miller report are sufficient to destroy the 
tobacco industry? 

A. I don't know if they're sufficient to destroy 
the tobacco industry, but I know that if penalty 
assessed it's a pretty major penalty and you would 
want to be as precise as you can with it. 

Q. Did the CPSC have authority to require payments 
by any product manufacturer? 

A. Yes, they did. 

Q. Did they ever do that? 

A. Yes, they did. 

Q. And in those instances did you require the CPSC 
to base this decision on — with information and to 
the same degree of precision that you were requiring 
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the smoking attributable health care estimates in 
this case? 

A. Those decisions to the best of my recollection 
were never predicated on the data we collected, but 
on the actual of a particular industry as it applied 
to the law with respect to them. 

Q. So these were in the nature of fines as opposed 
to damages? 

A. That's correct. 

Q. I take it that in imposing those fines you did 
not require the same degree of precision that you are 
requiring of the smoking material health care 
estimates in this case? 

A. I wasn't even in that loop. That was a decision 
between the general counsel's office, the director of 
compliance and the commissioners. 

Q. Do you know if they required the same degree of 
precision that you are requiring of the smoking 
attributable health care estimates in this case? 

A. I know for a fact they did not. 

Q. You know for a fact they did not, they required 
less precision; is that correct? 

A. They weren't using data, they were using 
violations of the law as a criteria. 

Q. Would you turn to page 18 of your report? The 
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last portion of your discussion of synthetic 
estimation you state that it is inappropriate to 
casually pass off the application of such a 
sophisticated concept as - quote - it is essentially 
what we do to estimate smoking attributable 
expenditures in Minnesota - end quote. Do you see 
that? 

A. Yes. 

Q. In your opinion in the refined model and the 
refined estimates of Drs. Zeger, Wyant and Miller as 
opposed to the core estimates do you believe that 
they inappropriately casually passed off the 
application of synthetic estimation as the quote here 
on page 18 cites? 

A. Well, it is a quote. 

Q. My question is, is that what you believe they 
did in the refined estimate as opposed to the core 
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estimate? 

A. Yes. 

Q. What is your understanding of the way in which 
the refined model makes a state estimate from 
national data? 

A. I don't have a full description of that, and 
that's why I go on to say in here that they provide 
no indication they employed any, but the simplest 
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most direct method of estimation. 

Q. And I think we discussed yesterday you haven't 
seen any of the information on computer disks that 
they provided along with their expert report, 
correct? 

A. That's correct. 

Q. Is it possible that reviewing that information 
would give you more information about the type of 
synthetic information they conduct? 

A. It's possible. 

Q. In forming your opinions do you think it's 
important to look at that information? 

A. I think it would be important to look — be 
important to look at any information that can 
enlighten me about the methods that they employed. 

Q. Have you requested that information from anyone? 
A. I requested whatever information was available 
at the time that I was looking at this, and that's 
what I used to draw my conclusions. 

Q. And the time that you were looking at this was 
basically the month of June, correct? 

A. I believe so. 

Q. Yesterday we talked about expert reports from 
the defendants that you had seen, and there was one 
other one I wanted to ask you about. Have you seen a 
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report of Professor Rubin? 

A. Yes, I've seen it. 

Q. Do you have a copy of it? 

A. No, I don't. Not with me, no. 

Q. Back in your office? 

A. Yes. 

Q. Have you read that report? 

A. Not carefully, no. 

Q. I think yesterday you told me that you had 
scanned some reports. Would you say that you scanned 
Dr. Rubin's report? 

A. Yes, I'm sure I did. 

Q. Do you have any plans to review that report 
further? 

A. Yes, when I have time. 

Q. Are you familiar with the concept of multiple 
imputation of missing data? 

A. I'm not familiar with it, I'm aware of it. 

Q. Are you familiar with propensity scoring 

methods? 

A. Again, I'm aware of it. 

Q. Have you ever used them? 

A. No. 

Q. Can you think of any situation in which the CPSC 
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used propensity scoring methods? 
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A. Not offhand, no. 

Q. Can you think of any situation in which the CPSC 
used multiple imputation methods for missing data? 

A. I think there were some times when they imputed 
data for some of the esoteric analysis on all terrain 
vehicles which came out after I left the agency, but 
I'm not very familiar with that. 

Q. Do you know what methods of imputation the CPSC 
used for that? 

A. No. 

Q. Other than that situation have you reviewed any 
work in which multiple imputation was conducted? 

A. Undoubtedly. 

Q. Do you know what imputation methods were used in 
those works? 

A. I can't give you anything off the top of my 
head. I can't even think of the particular studies, 
but I've read a lot of studies. 

Q. Do you know what a full bastion method of 
multiple imputation would be? 

A. Again, these are things I've heard of, but I'm 
not a statistician. 

MR. LOVE: Let's take a break. 

(Recess taken.) 

BY MR. LOVE: 
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Q. Dr. Verhalen, if you would turn to page 9 of 
your report, in particular the last bullet point 
there. 

A. I can't read the numbers on them and I think 
mine may be reversed. 

Q. Epidemiology has its limitations? 

A. Yes. 

Q. The first arrow point under that bullet point 
states that the concept of attributable risk cannot 
be readily applied to situations with intertwined 
multi-causal association and long temporal effects. 

Is that your opinion? 

A. Yes, it is. 

Q. Can attributable risk be applied at all to those 
situations? 

A. To complex intertwined effects and — 
multi-causal association and temporal effects? 

Q. Yes. 

A. Sometimes if you can assess and measure those 
associations. You have to know how many of them 
exist and the population is doing what their direct 
influence is and what any synergy between them and 
other potential effects of any particular exposure 
may be, what other exposure may lead to the same 
general medical condition. All of those things have 
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to be taken into account. 

Q. Is that another way of saying that you would 
have to control for every possible confounder? 
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A. Every known confounder, yes. 

Q. Based on your review of the literature is it 
your testimony that there is no information about 
smoke's attributable risk to lung cancer, for 
instance, where all known confounders have been 
controlled for? 

A. Not that I have seen. 

Q. Even if you controlled for all known confounders 
would synergistic effects still be a problem? 

A. Could be. 

Q. How would that be? 

A. Just a synergy between different compounders 

that may exist or coexist. A potential source of a 
condition coexisting with a second potential source 
may be worse or not worse than it would be acting 
independently. 

Q. And does controlling for confounders take 
control of that synergy? 

A. What? 

Q. Does controlling for confounders take control of 
that synergy? 

A. Not necessarily. You would have to know what 
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synergies and try and figure those out as well or 
adjust for them. 

Q. What about the relationship between smoking and 
COPD? Having reviewed the literature is it your 
belief that all of the known confounders of that 
relationship have not been controlled for at one time 
or another? 

A. That's correct. 

Q. Can you give me an example of a known confounder 
that has never been controlled for? 

A. No, I can't give you anything that has never 
been controlled for, but they all have to be 
controlled for in any given circumstance at the time 
you're doing your research. 

Q. So you need a single study that controls for all 
known confounders at the same time? 

A. That's right. 

Q. And also controls any synergies in effect that 
exist? 

A. That's right. 

Q. If you look at page 20 of your report — 
actually pages 19 and 20 where you discuss 
attributable risk in more detail, you conclude by 
stating on page 20 that because of the intertwined 
multi-causal associations and long latency period it 
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becomes very — 

A. Where are you reading? 

Q. See it there, page 20? 

A. Okay. 

Q. It becomes very difficult to employ the 
relatively simplistic computation of attributable 
risk. Do you see that? 

A. Yes. 

Q. Although it might be very difficult in your opinion 
it possible to employ the concept of attributable risk 


is 
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in those circumstances? 

A. It's possible to employ it, the interpretation of 
however, has to be very guarded because of potential - 
for having overlooked other potential causes. 

Q. Is it your opinion because in the case of 
smoking's relationship with major smoking related 
attributable diseases that — withdraw that. 

Is it your understanding that there is no study 
of the relationship between smoking and any of the 
major smoking attributable diseases listed in the 
Zeger, Wyant Miller report that controls for all 
confounders — all known confounders? 

A. Not having read all of the documents in there, 
there is no way I can say with assurance that none of 
them do, but none of the ones that I have read have 
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controlled for all of them, that's correct. 

Q. And unless for a particular disease there was a 
study that controlled for all known confounders would 
it be your opinion that one cannot compute 
attributable risk in a way that can be used to 
estimate smoking attributable health care costs for 
that disease? 

A. Not with the degree of precision necessary for 
the application that's being made here. If you were 
doing it for general program guidance that I toured 
where you might want to address remedial measures 
perhaps, it's of sufficient precision, but there is 
no way to ensure with a degree of certainty with this 
high impact that you have properly attributed the 
cause to — or the condition to any single cause. 

Q. Even in a problemistic sense? 

A. That's correct. 

Q. Earlier today we talked about flaws that you 
believe exist in the NMES data, correct? 

A. Yes. 

Q. Did you find any flaws in the State of Minnesota 
claims' data that was used by Drs. Zeger, Wyant and 
Miller? 

A. Not offhand that I recall. There may well have 
been, but I didn't list any. I can't think of any 
STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

294 


offhand though. 

Q. Did you find any flaws in the Blue Cross Blue 
Shield of Minnesota claims' data that was used by 
Drs. Ziegler, Wyant and Miller? 

A. Same answer. 

Q. I understand that you did review Dr. Miller's 
deposition and exhibits in the Mississippi 
litigation. 

A. Yes, sometime ago. 

MR. BORMAN: Which Dr. Miller are we 


talking about? 

BY MR. LOVE: 

Q. Dr. Leonard Miller. 

A. Yes, I did. 

Q. Is the model that was being described there in 
the Mississippi litigation during that deposition in 
the documents as what is referred to as the Robert 
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in the Mississippi litigation at the time you were 
preparing to be deposed in that case? 

A. No. 

MR. BORMAN: Before we go on, I will 
interpose a general objection. I am concerned since 
there were several iterations of Leonard Miller's 
model, without having the document in front of him it 
is easy to be talking about two different models, 
because I think Dr. Verhalen has been a little 
qualified of his acknowledgement of which model we're 
talking about. 

And I'm concerned since there were several 
versions that we may not be addressing the same one. 

MR. LOVE: I understand your 
objection, but you can go ahead and answer. Would 
you read the question back? 

(Record read.) 

THE WITNESS: I don't believe so. I 
think that by the time I was preparing for deposition 
in Mississippi I was looking at the Vernon Miller 
model. 

MR. BORMAN: Do you mean Vincent 

Miller? 


THE WITNESS: I'm sorry. Vincent 
Miller. Beg your pardon. V. Miller. 
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BY MR. LOVE: 

Q. Do you have any opinion as to whether the model 
used by Drs. Zeger, Wyant and Leonard Miller is more 
appropriate for estimating smoking attributable 
health care costs than the Robert Wood Johnson 
Foundation Model that Leonard Miller was using? 

MR. BORMAN: Same objection. 

THE WITNESS: I think there have been 
several refinements. I can't put my finger on them, 
but over the months there have been, as Mr. Borman 
said, several iterations, each one which had 
additional refinements. 

And this last one had additional 
refinements. Whether or not that made it more 
appropriate or not, I have my doubts because my 
reservations as expressed here haven't changed. 

There may be a few places it was cleaned up is all. 

BY MR. LOVE: 

Q. Do you have any opinion as to whether the model 
in the Zeger, Wyant, Miller report is better for 
estimating smoking attributable health care costs 
than any of the models that you reviewed in the 
Mississippi litigation? 

A. I don't know that. I know that I don't find the 
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model adequate. 
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Q. Which model? 

A. The current model that's used by the State of 
Minnesota. 

Q. So you have no opinion on the relative merits of 
the Robert Wood Johnson Model or any of the other 
models, the Mississippi vis-a-vis the Minnesota 
model? 

A. That's correct, with the addition of the fact 
that I recognize and acknowledge there have been some 
changes and attempts to improve it. 

Q. Which one? 

A. The current model being used by the State of 
Minnesota. 

Q. And you recognize that the current model in 
Minnesota includes — it tends to improve the models 
used in Mississippi; is that what you are saying? 

A. That's what I was saying. 

Q. Do you believe any of those attempts were 
successful? 

A. I don't believe they were adequate. 

Q. Do you believe that the model was improved in 
any way? 

A. It may have been. I don't know. 

Q. Do you have any opinion regarding the relative 

merit of any model used for estimating health — 
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smoking attributable health care costs in the Texas 
litigation versus the Minnesota model? 

A. No, because I really don't look at them 
juxtaposed to one another. 

Q. What do you mean by that? 

A. I look at the model that you're using in 
Minnesota and determine whether or not it meets what 
I would think would be necessary as a model to make 
estimates for the State of Minnesota. 

I find them wanting for reasons what we have 
discussed over the past two days, and I don't look 
back to the other models to see whether or not they 
would be better, worse or anything else because I 
don't think they're relevant. 

Q. So you don't have any opinion then about the 
relative merits of any of these models? 

A. No, I don't. 

Q. Dr. Verhalen, are you familiar with an analysis 
that was performed by Dr. Manning in examining costs 
associated with smoking? 

A. I recall having looked at something fairly early 
on and I think it was among my list of documents. 

Q. I'm referring to a book called The Cost of Poor 
Health Habits by Willard G. Manning. Is that what 
you're referring to? 

STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

299 

A. No. I'm talking about his article. Taxes of 
Sins. Do Smokers and Drinkers Pay Their Way. 

Q. In reviewing the expert reports of Foster or 
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Rubin or McCall and Ahlberg or Wecker do you recall 
an argument that Drs. Zeger, Wyant and Miller are 
addressing the wrong question in their analysis, and 
that what they should be looking at is what are the 
costs resulting from any conduct of the tobacco 
industry in providing data or withholding data or 
developing a safer cigarette? 

A. Is that the end of your question? 

Q. Yes. 

A. I recall some mention of the fact they should be 
measuring things with reference to wrongdoing, but as 
I said, I just scanned those articles. I didn't read 
them thoroughly, those reports. 

Q. Do you believe that the data exists that would 
allow one to measure the health care costs resulting 
from such wrong doing? 

A. I have no idea. I hadn't given it any thought 
yet. 

MR. LOVE: Would you mark this for us 

please? 

(Plaintiffs' Deposition Exhibit No. 3311 - article - 
marked for identification.) 
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BY MR. LOVE: 

Q. Dr. Verhalen, do you believe that it's possible 
to measure with a marked degree of precision that you 
require for smoking attributable health care 
estimates the cost involved when a person who had 
smoked for X years continued smoking for another 
period of time, let's say Y years? Could you measure 
the costs associated with that during the Y period? 

A. Someone who continued to smoke for X years and 
then quit for Y years? 

Q. No. They had smoked for X years, let's just say 
ten years, and they continued to smoke for another 
five years. 

Do you believe it's possible to measure with a 
degree of precision that you require the health care 
costs attributable to that second five year period of 
smoking? 

A. My guess is that conceivably it could be. It 
would probably be expensive because you would need an 
awful large sample of people with very discreet 
information on smoking habits and length of smoking. 

Anything's possible, but you have to be willing 
to pay the price to collect the data. 

Q. Do you believe that any of the data that you've 
seen would allow that type of estimate to be made? 
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A. Not so far. 

Q. Would you have the same causal objection to any 
type of estimate that you simply could not attribute 
any amount to the fact that someone smoked for that 
second five year period? 

A. Unless one were able to control for all other 
confounding factors, yes, I would have the same 
causal concern. 

Q. And you would also have to control for all 
synergistic effects, right? 
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A. That's correct. 

Q. Do you know of any way to determine the 
probability that a certain percentage of smokers 
would quit smoking if certain information about 
smoking was disclosed to them? 

A. I'll have to hear that one again. 

MR. BORMAN: Object to the form of the 

question. 

BY MR. LOVE: 

Q. Do you know of any way to determine the 
probability that some percentage of smokers would 
quit smoking if certain information was disclosed to 
them? 

MR. BORMAN: Again, same objection. 

THE WITNESS: I haven't given it any 
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thought, but as I said, I think almost anything is 
possible if you're willing to pay to collect the 
information. 

I presume there is a way, but I would have 
to look into that very carefully. 

BY MR. LOVE: 

Q. At this point in time you don't know what type 
of data you would need? 

A. That's correct. 

Q. Dr. Verhalen, I'll show you what we have marked 
as Exhibit 3311, it's the expert report of Edward 
Foster dated July 17, 1997 titled The Cost of Smoking 
to the State of Minnesota and to Blue Cross and Blue 
Shield of Minnesota. 

Is that the Foster report that you received a 
copy of sometime ago? 

A. Yes. 

Q. And that's the report that you've scanned, but 
have not yet read; is that correct? 

A. That's correct. 

Q. If you'd turn to page 10 of that report you'll 
see a discussion of the Manning study there. 

A. Yes. 

Q. Would you take a few minutes to take a look at 
that? My question is going to be whether the study 
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that's discussed here is the same study that you 
recall reading about earlier. 

A. Do you want me to read the whole thing? 

Q. Enough for you to determine if this is the same 

study that you had read about previously. 

A. Maybe. Some of it looks familiar, but I really 
don't know. 

Q. Would you look under the item number 2 on page 
10, that statistical study based on individual 
households? 

Do you see that the basic data source was a Rand 
Corporation Health Insurance Experiment? 

A. Yes. 

Q. And that that study looked at families in 
Dayton, Ohio, Seattle, Washington, Fitchburg 
Massachusetts, Charleston, South Carolina and two 
rural counties, one in Massachusetts and one in South 
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Carolina? 

A. Yes. 

Q. In your opinion would such a data set be 
appropriate for estimating health care costs in 
Minnesota? 

A. I have my doubts, but I would really want to be 
able to sit down and read everything that's said 
about it, and I would want to read the Rand 
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Corporation document as well. 

Q. Given that none of the data in the Rand study 
came from the State of Minnesota, given your 
requirements for synthetic estimation, how could it 
possibly be reliably used to make a Minnesota 
estimate? 

A. I don't know. I'd want to take a look at it. 

Q. If the primary purpose of the Manning study was 
to see how variations of the health insurance program 
would affect behavior, those enrolled in the 
alternative plans, would you be concerned about using 
such a study to estimate health care costs in 
Minnesota? 

A. On the surface of it, yes, I probably would. 

Q. And if the Manning study excluded people over 
sixty-two years of age would that cause you concern 
about using that study to estimate health care costs 
in Minnesota? 

A. Same answer, it could. 

Q. If the study also excluded families with incomes 
greater than twenty-five thousand dollars, assuming 
that would translate to eighty-eight thousand dollars 
in '96 measures, would that cause you concern about 
using the study to estimate health care costs in 
Minnesota? 
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A. Same answer. 

Q. And if the Manning study made any use of self 
reported information would that also cause you 
concern about using that? 

A. It could. 

Q. Do you believe that any estimate of health care 
costs in Minnesota can be made without using actual 
Minnesota data on health care costs? 

A. You might be able to, but it depends on the use 
you're going to put it to, whether or not it would be 
rigorous enough. 

Q. If you were going to use it to estimate smoking 
attributable health care costs in this litigation. 

A. In this litigation? 

Q. Yes, sir. 

A. No, I don't think so. It would require great 
rigor. 

Q. If you look at pages 7 and 8 of this exhibit, 
3311, are you familiar with any of the equations that 
are listed there? 

A. I don't know. I haven't really studied them. I 
may have seen them, but I am not a statistician. I 
don't normally do this kind of work. This is what I 
would have a statistician do. 
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11:52:19 1 evaluating equations such as these? 

11:52:22 2 A. Not without help from a statistician. I would consult a 

11:52:30 3 statistician on that. 

11:52:32 4 Q. As you read, scanned, this report of Dr. Foster, 

11:53:03 5 Exhibit 3311, did you note any questions that you'd 

11:53:08 6 like to follow up on or information that you'd like 

11:53:10 7 to have about it? 

11:53:12 8 A. No. I was just scanning it very quickly to see 

11:53:15 9 what the general tenure of them was, what they were 

11:53:18 10 including, what they were not including, not any 

11:53:25 11 substantive review of anything. To me, scanning 

11:53:28 12 means scanning. 

11:53:28 13 Q. Based on your understanding of the general 

11:53:31 14 tenure of this report do you believe that the 

11:53:34 15 approach that Dr. Foster is using would provide any 

11:53:41 16 estimate of smoking attributable health care costs in 

11:53:45 17 Minnesota that would meet the degree of precision 

11:53:48 18 that you would require in this litigation? 

11:53:50 19 A. I am not in a position to say at this time. 

11:53:52 20 MR. LOVE: Why don't we take a break. 

11:58:05 21 (Recess taken.) 

12:05:11 22 BY MR. LOVE: 

12:05:11 23 Q. Dr. Verhalen, based on the descriptions of the 

12:08:47 24 Manning study that we reviewed on pages 10 and 11 of 

12:08:56 25 Dr. Foster's report. Exhibit 3311, excluding the fact 
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12:09:04 1 where the survey was conducted and so on, do you have 

12:09:10 2 an opinion as to whether it is more or less reliable 

12:09:13 3 for making estimates in Minnesota than NMES? 

12:09:17 4 A. No. I can't make that judgment on the basis of 

12:09:22 5 that review. 

12:09:32 6 Q. With respect to NMES would you agree that the 

12:09:46 7 NMES — strike that. With respect to NMES would you 

12:09:49 8 agree that the sign, administration and 

12:09:52 9 interpretation of that survey was appropriately 

12:09:55 10 controlled to ensure the objectivity of the survey? 

12:10:06 11 A. Possibly. I would want to look at it again to 

12:10:08 12 address specifically the subject of objectivity, but 

12:10:12 13 it probably is. My recollection is nothing jumps 

12:10:20 14 out. 

12:10:20 15 Q. Would you agree that the experts who designed, 

12:10:26 16 conducted and analyzed the survey were appropriately 

12:10:27 17 skilled and experienced? 

12:10:29 18 A. I have no way of knowing that. 

12:10:30 19 Q. At the national level did NMES have an 

12:10:41 20 appropriate identification of a universe or 

12:10:46 21 population to do the survey? 

12:10:54 22 A. I think it probably did, yes. 

12:10:56 23 Q. And at the national level did the sampling frame 

12:10:59 24 approximate the population? 

12:11:06 25 A. It probably did. Again, it was — its main 
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12:11:10 1 difficulty was the fact was that it was handled as 

12:11:15 2 two separate pieces which may present a problem. I 

12:11:20 3 would have to look at it very, very carefully. 
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Q. That's your only qualifications about the 
sampling frame? 

A. Yes. 

Q. Was the level of non-response in NMES a concern 
for you? 

A. Not particularly troublesome. 

Q. Were the NMES questions framed to be clear, 
precise and unbiased? 

A. I think they might have been framed for that. 

How successful they were is one of the main questions 
I have, especially with respect to the self 
administered questionnaire. 

The question always remains whether or not 
people are properly interpreting a question and 
giving an appropriate response. You do the best you 
can. 

Q. Can you give me any examples of questions in 
NMES that you think should have been framed 
differently? 

A. Not off the top of my head. 

Q. Did you note any such questions in your expert 

report? 

STIREWALT & ASSOCIATES 

P.0. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

309 

A. No. 

Q. Do you have any notes anywhere of any type about 
any such questions? 

A. No, I don't have any notes. 

Q. Do you believe that NMES made appropriate 
choices for using open ended and closed ended 
questions in a survey? 

A. I don't know about that. 

I would want to look at the questionnaire from 
the standpoint of a questionnaire designed 
specifically with that in mind. 

Q. Were the NMES interviews appropriately selected 
and trained? 

A. The presumption and hope is that they were, but 
there is no assurance that they were uniformly 
trained or that they uniformly conducted the 
interviews, and that's one of the basic problems with 
having two separate organizations to it. 

Q. Have you seen any discussion of the selection 
and training of the NMES interviewers? 

A. I seem to recall seeing some right offhand. I 
can't seem to recall much about it. 

Q. Do you know whether Drs. Zeger, Wyant and Miller 
have the skill and expertise to analyze the NMES 
data? 
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A. I would presume they do. 

Q. In your expert report under tab 4 you listed 
deposition and trial testimony that you've given, 
correct? 

A. Yes. 

Q. What time period did that cover? 

A. From the day I retired in April of '95 up to 
whatever the date was that I filed my report, the 
25th of June. 

Q. Prior to the time that had you retired had you 
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testified at either deposition or trial? 

A. I was deposed on something back in the very, 
very early days of the Commission. I don't even 
remember the subject matter, but it was before the 
general counsel made a ruling that from that point on 
employees of the commission could not be deposed. 

Q. A ruling with which I'm sure you agreed? 

A. I had no position one way or the other. It 

didn't particularly bother me. 

Q. Have you ever testified before any government 
agency? 

A. I have testified before the National Commission 
on Product Safety when I was a member of the 
Commission staff. I testified before the 
Commissioner on bicycle injuries. 

STIREWALT & ASSOCIATES 

P.0. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

311 

Q. What was the nature of your testimony there? 

A. It was on the subject of high rise bicycles as a 
proportion of total bicycles involved in accidents. 

At the time the high rise was a new bicycle that had 
come on to the scene from Southern California and 
there were a large number of injuries that were being 
reported in the fourteen hospitals that we had 
reporting to us at that time where youngsters had 
tried to jump curbs with their bikes, and because of 
the small front wheel the bicycle just came to a dead 
halt and they went over the handle bars. 

Q. Had you done any statistical analysis of — 

A. No, that was a descriptive testimony. 

Q. Any other testimony before any government 
agency? 

A. No. 

MR. LOVE: Would you mark this? 
(Plaintiffs' Deposition Exhibit No. 3312 - article - 
marked for identification.) 

BY MR. LOVE: 

Q. Dr. Verhalen, I'll show you what we have marked 
as Exhibit 3312. It consists of an article in 
Morbidity and Mortality Weekly Report titled State 
and Sex Specific Prevalence of Selected 
Characteristics - Behavioral Risk Factor Surveillance 
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System, 1994, 1995. And the first two pages of the 
exhibit are some statistics that were taken from that 
article. 

I'll ask if you've seen that before, sir. 

A. Yes, I did. 

Q. Have you had a chance to review the statistics 
on the first two pages of that exhibit? 

A. Yes. 

Q. Is it your understanding that the statistics 
shown under the column called Minnesota show a — the 
prevalence value of those statistics in the State of 
Minnesota during the time indicated, and in 
parenthesis show the ninety-five percent confidence 
interval for that statistic? 

A. Yes. 

Q. Is it also your understanding that under the All 
State column that we see, the All State prevalence. 
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but this time in parenthesis we see a confidence 
based on plus or minus one standard deviation? 

A. Correct. 

Q. Is a plus or minus one standard deviation 
confidence interval approximately a sixty-eight 
percent interval? 

A. That's roughly correct. 

Q. That would be a narrower interval than the 
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ninety-five percent confidence interval, correct? 

A. That's correct. 

Q. Would you agree. Dr. Verhalen, that where all 
the factors shown on these first two pages of Exhibit 
3312 that there is at least some degree of overlap in 
the confidence interval, the ninety-five percent 
confidence interval, for Minnesota and the plus or 
minus one standard deviation confidence interval for 
all states? 

A. Yes. 

Q. Having reviewed these statistics have you come 
to any conclusions as to their significance in terms 
of showing similarity or difference between Minnesota 
and the nation as a whole? 

A. For these particular subject areas it would 
suggest that in 1995 the differences probably were 
not significant. They were not significant. 

Q. Are there any of the items on these first two 
pages of Exhibit 3312 that you would add to the list 
of important factors that we discussed yesterday in 
comparing Minnesota to the nation? 

A. I could reasonably add all of them, but those 
dealing with risk taking behavior, as I said 
yesterday, I consider somewhat less important. 

Q. Would that be the drinking statistic? 

STIREWALT & ASSOCIATES 

P.O. BOX 18188, MINNEAPOLIS, MN 55418 1-800-553-1953 

314 

A. That's correct. 

Q. So that would be less important than the other 
statistics shown on this exhibit? 

A. Probably. 

Q. Did you review the — any other portion of the 
article that's part of Exhibit 3312? 

A. Yes, I reviewed the entire exhibit. 

Q. Did you find any information there that you 
found to be significant in comparing Minnesota to the 
nation? 

A. Not where one could say it was necessarily 
statistically significant, because one couldn't look 
at the error margins in the national data. 

The national data wasn't presented and I didn't 
have the capability of generating that. 

Q. Dr. Verhalen, I have a book that was on your 
Minnesota bibliography list in your expert report. 

I'm not going to mark it as an exhibit, but I would 
like to show it to you. 

It's titled Epidemiologic Methods. The authors 
are Bryant MacMahon, Thomas Pugh, and Johannes Ipsen 
published by Little Brown Company with a copyright 
date of 1960. 

Do you recognize this as being one of the books 
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in your bibliography? 
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A. Yes, I do. 

Q. Are you familiar with that book? 

A. Yes. It was the textbook we used when I was 
studying epidemiology at the Master's level. 

Q. Is it an authoritative text on epidemiology? 

A. It's a text on epidemiology. 

Q. Is it a text that's commonly used by 
epidemiologists? 

A. It was at that time. There are probably newer 
textbooks that are used today. Every professor wants 
to make his share of the pie. 

Q. At the time you were studying epidemiology it 
was a standard text? 

A. It was a text at the University of North 
Carolina while I was working on my degree. I don't 
know what was being used at other schools. I'm sure 
it was used at Harvard. That's where the authors 
were from. 

Q. The authors were from Harvard University? 

A. Yes. 

Q. Do you know which item that is in your Minnesota 
bibliography by chance? 

A. Not offhand. I can find it here. Number 05, 

205. 

Q. Thank you. And that's the bibliography 
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that's — 

A. Tab 6 I guess. 

Q. — tab 6 of your expert report. Exhibit 3301, 
correct? 

A. I think so. 

Q. In the Texas litigation that we have discussed 
somewhat have you been deposed in that case? 

A. No. 

Q. Have you read any deposition transcripts from 
that case? 

A. I'm sure I did, but I really don't recall with 
respect to that case because at the same time 
Mississippi was going on. 

Q. Is V. Miller involved in both Mississippi and 
Texas? 

A. Yes. 

Q. Since our discussion yesterday have you recalled 
any other expert reports in this case that you've 
scanned or even seen? 

A. No, I hadn't thought about it. 

MR. LOVE: Dr. Verhalen, subject to 
the reservations I had mentioned previously about 
reviewing your published articles and also what to do 
in the case that the Court rules that we are allowed 
to inquire between conversations between you and 
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defense counsel, I have no further questions. Thank 
you. 

MR. BORMAN: No questions. We will read and 
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4 sign, and as I said earlier we would like a hard copy of 

5 the deposition please. 
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